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The present invention utilizes a graphics layout language that 
is defined by the broadcaster or the studio to control the layout of 
graphic overlays in relation to corresponding images presented on 
a display. Each user interface component is divided into objects 
that define their individual behaviours and presentations. Data 
files using the hypertext markup language, HTML, layout these 
objects on the screen. By varying the HTML data files, control is 
provided to the broadcaster over what objects are displayed on the 
screen, where they are placed on the screen, and to a limited effect, 
their behaviour. This can be accomplished without re-writing the 
executables as would be necessary in other television type user 
interface implementations. 
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GRAPHIC LAYOUT CONTROLLER FOR 
TELEVISION ENVIRONMENT 

5 

Related Applications 
This application relates to the co-pending, co-filed, and co-assigned 
applications entitled "System for using a channel and event overlay for invoking 
channel and event related functions," "Multipurpose channel banner," 
1 0 "Displaying layered information using lenticular-like interfaces," and 
"Mutatably transparent controls," all of which are hereby incorporated by 
reference. 

Technical Field of the Invention 
The present invention relates generally to graphical user interfaces and in 
1 5 particular to controlling the layout of graphics in a television environment. 

Background of the Invention 
In the majority of television viewing environments today, when a user 
tunes to a specific channel, the graphical interface for that channel is defined 
primarily by the television manufacturer. For example, when a broadcaster 
20 displays a station identifying logo with their video transmission, they have no 
control over the positioning of their logo. Many times this logo is covered by a 
user selected menu option when overlaid on the television screen with the 
transmitted video. 

In recent environments, graphical interfaces have provided a greater level 
25 of functionality with the advent of direct satellite system set top boxes (STB), 
such as DSS and EchoStar. In addition to television displays, the user has 
channel banners, menus, electronic program guides and message alerts. In some 
circumstances, such as with inclement weather announcements and breaking 
news events, the user may customize the interface. However, the amount of 
30 functionality presented by these graphical interfaces is minimal since there is 
little interaction by a user, other than changing the channel or adjusting the 
volume. 

In particular, these functions provided by an STB manufacturer occupy a 
portion of the display screen when selected by the user, such that the television 
35 broadcaster's logo or call letters are very likely to be covered up if displayed on 
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the display screen at the same time a user is operating the electronic program 
guide, for example. The broadcasters have no control over the positioning of 
their station identifying information or other types of data they may wish to have 
in full view when displayed concurrently with user selected display options. 
5 With the DSS and EchoStar systems, the additional user interfaces have been 
designed and implemented by STB manufacturers with little regard for the needs 
or concerns of the television broadcaster. 

Therefore, there is a direct conflict between the manufacturer's need to 
define the various functions provided by a direct satellite* STB and the 

10 broadcaster's need to broadcast unobstructed graphical symbols and other 
information to viewers. 

Furthermore, this problem is not just limited to television broadcasts and 
receptions within the United States, but worldwide. This tension between the 
manufacturers and the broadcasters will increase as the boundaries of televisions 

1 5 and computing devices blur with the evolution of televisions adapting to the 
digital age and as data services become more readily available. 

This convergence between televisions and computers can be illustrated 
by the efforts of Microsoft and Intel, where efforts have been made in 
developing strategies and approaches for integrating televisions into the personal 

20 computer (PC). For instance, Broadcast PC has been developed by Microsoft 
and Intel has developed Intercast, but they do not allow for the broadcaster's total 
control of the television environment. In both developments, a broadcaster is 
limited to controlling the look and feel of their services, but has no control of 
their primary product, which is the broadcast event. 

25 Windows CE, OS-9 and OpenTV are all operating systems that are 

attempting to deliver more sophisticated user interfaces to the manufacturer, but 
they too are disregarding the needs of the broadcaster. These operating systems 
still cover up the broadcast content with banners and menus that are genericized 
to the lowest common denominator of services and functions offered. 

30 Therefore, there is a need to permit broadcasters to have greater control 

in the television environment they transmit to their viewers. Specifically, there 
is a need for the broadcasters to broadcast unobstructed graphical symbols and 
other information to viewers. 
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Summary of the Invention 
The above mentioned shortcomings as well as other problems are 
addressed by the present invention which will be understood by reading and 
studying the following specification. The invention describes a computerized 
5 system for controlling graphics in a television environment. 

In one embodiment of the invention, the computerized system comprises 
a hardware component having a personal computer (PC) mode and a television 
(TV) mode, a computer-readable medium and a graphical user interface 
component for viewing the television mode. Also included is an application 
10 program executed by the hardware component from the computer-readable 

medium, wherein each application program independently controls the layout of 
graphics displayed via the graphical user interface when overlaid with a video 
image provided by the hardware component operating in the television mode. 

A graphics layout language, such as hypertext markup language (HTML), 
15 is used to layout graphical user interface components and manage behaviors of 
displayed graphics in the television environment. Control of the graphics 
display allows a broadcaster to reposition their graphical symbols and other 
information to be overlaid with the broadcaster's corresponding transmitted 
television video. The invention is particularly beneficial when reposition of the 
20 broadcaster's graphics is necessary if a manufacturer's selection of user selected 
options to be displayed on a screen covers part or all of the broadcaster's 
displayed graphics. 

Therefore, utilization of a graphics layout language defined by the 
broadcaster allows control on the layout of graphic overlays in relation to 
25 corresponding images presented on a display. In different embodiments of the 
invention, computers, computerized systems and computer-readable media of 
varying scope are described. Still other and further embodiments, aspects and 
advantages of the invention will become apparent by reference to the drawings 
and by reading the following detailed description. 
30 Brief Descr iption of the Drawings 

Figure 1 is a diagram of a typical computer in conjunction with which 
embodiments of the invention may be implemented; 
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Figure 2 is a diagram of a computerized system for a convergence 
environment; 

Figures 3(a)-(c) illustrate a HTML-pseudocode controlling the display of 
an XYZ logo when displayed on a screen. 
5 Figures 4(a)-(b) illustrate a HTML-pseudocode providing a channel 

banner that partially covers a television video. 

Figure 5(a)-(b) illustrate a HTML-pseudocode providing a menu which 
overlays a television video. 

Figure 6(a)-(b) illustrate a HTML-pseudocode providing a data services 
1 0 display area which overlays a television video. 

Figures 7(a)-(b) illustrate a HTML-pseudocode providing an electronic 
programming guide which overlays a television video. 

Figure 8 is a representation of the various television components that 
provide television capability for the present invention. 
15 Figure 9 illustrates a new page layout received in-band by the television 

components. 

Figure 10 illustrates the display of a new page layout by the television 
components. 

Detailed Description of the I nvention 
20 In the following detailed description of the preferred embodiments, 

reference is made to the accompanying drawings which form a part hereof, and 
in which is shown by way of illustration specific preferred embodiments in 
which the inventions may be practiced. These embodiments are described in 
sufficient detail to enable those skilled in the art to practice the invention, and it 
25 is to be understood that other embodiments may be utilized and that logical, 
mechanical and electrical changes may be made without departing from the 
scope of the present inventions. The following detailed description is, therefore, 
not to be taken in a limiting sense. 

Referring first to Figure 1 , a diagram of a typical computer in 
30 conjunction with which embodiments of the invention may be implemented is 
shown. Computer 1 10 is operatively coupled to monitor 1 12, pointing device 
1 1 4, and keyboard 1 1 6. 
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Computer 1 10 includes integrated therein or coupled thereto hardware to 
provide for what is known in the art as a "convergence environment" such that 
computer 1 10 provides capability beyond ordinary PC operation. To implement 
the present invention, television capability must be included as part of this 
5 convergence environment. Such hardware components are known and available 
within the art. For example, the Gateway Destination PC/TV system, available 
from Gateway 2000, Inc., provides a convergence environment across two 
primary modes of operation: TV viewing and PC operation. 

Embodiments of the present invention are amenable to inclusion into 

10 and/or development in conjunction with a software architecture of a 

computerized convergence system as described in co-assigned and co-filed 
application titled "Architecture for Convergence Systems," which is hereby 
incorporated by reference. 

In addition to television capability, computer 110 includes a processor 

15 (for example, an Intel Pentium processor), random-access memory (RAM) 
(preferably, at least thirty-two megabytes), read-only memory (ROM), and one 
or more storage devices, such as a hard disk drive, a floppy disk drive into which 
a floppy disk can be inserted, an optical disk drive, and a tape cartridge drive. 
The memory, hard drives, floppy disks, etc., are types of computer-readable 

20 media. The invention is not particularly limited to any type of computer 1 10. 
Computer 110 preferably is a PC-compatible computer running an operating 
system such as Microsoft Windows. The construction and operation of such 
computers are well known within the art. 

To support television viewing capability, computer 1 10 includes a TV 

25 tuner and/or a cable decoder. Computer 1 1 0 desirably provides for integration 
with or includes audio/video (i.e., multimedia) devices including but not limited 
to: a sound card, a digital video disc (DVD) player, a direct broadcast satellite 
(DBS) receiver, audio/video inputs for external or auxiliary devices, a CD-ROM 
player, an audio/video tuner having at least radio tuning capability, a video 

30 cassette recorder, a laser disc player, a compact disc player, a DBS integrated 
receiver-decoder (IRD), and a video camera. 

Computer 1 10 may also be communicatively connected to the Internet, 
any particular manner by which the invention is not limited to, and which is not 

SUBSTITUTE SHEET (RULE 26) 



WO 99/35832 



PCT/US99/00098 



6 

shown in Figure 1 . Internet connectivity is well known within the art. In one 
embodiment, the computer includes a modem and corresponding communication 
drivers to connect to the Internet via what is known in the art as a "dial-up 
connection." In another embodiment, the computer includes an Ethernet or 
5 similar hardware card to connect to a local-area network (LAN) that itself is 
connected to the Internet via what is known in the art as a "direct connection" 
(e.g., Tl line, etc.). Other embodiments of "direct connections" include 
connection through satellites and connection via a cable modem. 

Monitor 112 permits the display of information, including computer, 

1 0 video and other information, for viewing on a screen by a user of the computer. 
The invention is not limited to any particular monitor 112. Such monitors 
include cathode ray tube (CRT) displays, as well as flat panel displays such as 
liquid crystal displays (LCD's). 

Pointing device 114 permits the control of the screen pointer provided by 

1 5 the graphical user interface of operating systems such as versions of Microsoft 
Windows. The invention is not limited to any particular pointing device 1 14. 
Such pointing devices include mouses, touch pads, trackballs, remote controls 
and point sticks. 

Finally, from a hardware perspective, keyboard 116 permits entry of 
20 textual information into computer 1 10, as known within the art, and the 

invention is not limited to any particular type of keyboard. Desirably, keyboard 
1 16 is a wireless keyboard. 

Computer 110 also has at least one hypertext-markup-language (HTML) 
operating environment running thereon, which may utilize the Internet 
25 connectivity. Such operating environments are typically software such as 

Netscape Navigator and Microsoft Internet Explorer, both of which provide an 
HTML operating environment, and also access to the Internet's world-wide web 
(WWW), Usenet newsgroups and electronic mail features. The invention is not 
limited to any particular HTML operating environment, however, and the 
30 construction and use of such operating environments are well known within the 
art. 

Referring next to Figure 2, a diagram of a computerized system for a 
convergence environment allowing for the control of graphics in a television 
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environment is shown. The computerized system includes the following 
components: hardware component 210, drivers component 212, system services 
component 214, views component 216 and overlays component 218. Each of 
these components is described in general within the following paragraphs. 
5 Hardware component 210 includes the necessary hardware to provide the 

convergence environment in which personal computer 1 10 is integrated with 
television capability. Such hardware components are known and available 
within the art. As previously stated, the Gateway Destination PC/TV system, 
available from Gateway 2000, Inc., provides a convergence environment system 

1 0 in which TV and PC capabilities are included. 

Drivers component 212 provides a plurality of drivers, which include 
low-level functionality that cooperate directly with hardware component 210 of 
the computerized system. The drivers thus provide the manner by which the 
other components of the software architecture interface with hardware 

15 component 210. The drivers act as the lowest level of abstraction within the 
software architecture. Examples of drivers include application programming 
interfaces (API's), as known within the art, such as those available within 
Microsoft Windows and available from other operating systems. 

Systems services component 214 interfaces with drivers 212 to provide a 

20 plurality of system services, which include functions and user interfaces shared 
by multiple views provided by views component 216 and multiple overlays 
provided by overlays component 218. System services also include functions 
that may provide a hardware abstraction layer that is not provided by the drivers 
of drivers component 212. That is, system services component 214 provides a 

25 hardware abstraction layer so that views component 216 and overlays component 
218 do not have to directly access hardware component 210 or drivers 
component 212 and/or also provides a set of commonly used functions and user 
interfaces to views component 216 and overlays component 218. 

View component 216 provides a plurality of views, which are full-screen 

30 graphical user interfaces that define a context for a user of the computerized 
system. Examples of views include a full-screen TV window, in which a 
television station may be viewed to provide the TV context for implementation 
of the present invention, and the standard PC window, such as a windows 
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desktop in the case of Microsoft Windows 95 to provide a PC context. Views 
are graphical user interfaces that may be associated with a given application or 
applications, and are specific to that application or applications. 

Overlays component 218 provides a plurality of overlays, which are 
5 partial screen graphical user interfaces displayed consistently across all views 
and modes of operation. That is, while a view is specific to a given application - 
- such as a TV window, or a PC window ~ an overlay is displayed regardless of 
the selected view. It is laid over the current view, and is not specific to the view. 
Examples of overlays include a channel banner, which displays the current 
10 channel which is being tuned to, and a favorites list, which displays a list of 
favorite channels. Note that both overlays and views are considered user 
interfaces of the software architecture, and overlays component 218 and view 
component 216 may be conceptualized as a user interface component. 

Referring to Figure 3, the present invention utilizes a graphics layout 
15 language, such as HTML, that is defined by the broadcaster or the studio to 
control the layout of the overlays in relation to the image presented on screen 1. 
With respect to the present invention, the image is television video. 

Figure 3 illustrates HTML-pseudocode 4 used to control the display of 
the XYZ logo 2 when displayed on screen 1. When the user tunes to the XYZ 
20 channel, XYZ logo 2 appears for several seconds in Figure 3(a) before 

disappearing 3 in Figure 3(b). This behavior is defined by HTML-pseudocode 4, 
as illustrated in Figure 3(c). 

HTML-pseudocode 4 illustrates TV object 5 that contains several 
attributes: object 6 and two behaviors 7,8 for object 6. First behavior 7 states 
25 that if the user selects the "display button" on pointing device 1 14, the 

"XYZBanner" HTML document is displayed. Second behavior 8 states that if 
the user selects the "menu button" on pointing device 1 14, the "XYZMenu" 
HTML document is displayed. 

Second object 9 describes the XYZLogo that appears temporarily when 
30 the channel is selected. First parameter 1 1 describes the rate at which logo 2 
spins. Second parameter 12 describes how long logo 2 is displayed before 
disappearing. 
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If the user selects the "display button" on pointing device 1 14, the screen 
illustrated in Figure 4(a) appears. Figure 4(b) illustrates HTML-pseudocode 16 
providing channel banner 15 that partially covers television video 14. An 
inventive aspect of this invention is that the broadcaster can define not only how 
5 banner 1 5 is to be presented (in terms of its contents), but the broadcaster can 
control the size, position and relationship between banner 15 and television 
video 14. For example, the broadcaster has complete control over such decisions 
as to whether banner 15 should be transparent or opaque, oriented vertically or 
compress the video rather than overlaying it. Alternatively, if the broadcaster 
1 0 did not provide banner 1 5 behavior, the manufacturer could provide a default 
position. 

The sample HTML-pseudocode 16 in Figure 4(b) describes a screen that 
includes TV object 17 and banner object 21. TV object 17 displays XYZ 
channel video 18 at full screen and has two behaviors. First behavior 19 states 

15 that if the user selects the "display button" on pointing device 1 14, the 

"XYZChannel" HTML document is redisplayed, thus hiding banner 15. Second 
behavior 20 states that if the user selects the "menu button" on pointing device 
1 14, the "XYZMenu" HTML document is displayed. 

Second object 21 describes XYZ Banner object 22 that appears 

20 temporarily at the top of the screen. First parameter 23 identifies the current 
program, which may be stored in an electronic program guide (EPG) database. 
Second parameter 24 describes how long banner 15 is displayed before 
transitioning back to the channel. 

If the user selects the "menu button" on pointing device 1 14, the screen 

25 illustrated in Figure 5(a) appears. Figure 5(b) illustrates an HTML-pseudocode 
27 providing menu 26 which overlays television video 25. 

Sample HTML-pseudocode 27 in Figure 5(b) describes TV object 28 and 
menu object 32. TV object 28 displays XYZ channel 29 video at full screen and 
has two behaviors. First behavior 30 states that if the user selects the "display 

30 button" on pointing device 1 14, the "XYZBanner" HTML document is 

displayed. Second behavior 31 states that if the user selects the "menu button" 
on pointing device 1 14, the "XYZChannel" HTML document is re-displayed. 
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Second object 32 describes how XYZ Menu 33 appears temporary at the 
side of the screen. First parameter 34 identifies the name of the first menu item, 
and second parameter 35 identifies the name of the second menu item. 

If the user selects a "sports'* menu item that is displayed as an option 
5 from XYZ menu 33, the screen illustrated in Figure 6(a) is displayed. Figure 
6(b) illustrates HTML-pseudocode 38 providing data services display area 37 
which overlays television video 36. 

Sample HTML-pseudocode 38 in Figure 6(b) includes TV object 39 and 
data services object 43. TV object 39 displays XYZ channel video 30 at 50% 
10 vertical 41 and 100% horizontal 42. Second object 43 describes XYZ Sports 
services 44 that appears at the bottom of the screen. First parameter 45 tells 
sports services 44 to query the user's system for their favorite sports; second 
parameter 46 identifies the rate at which the sports scores scrolls. 

Figure 7(a)-(b) illustrates HTML-pseudocode 49 controlling the display 
15 of an electronic programming guide 48 which overlays television video 47. This 
also illustrates how a GWC channel (i.e., a Gateway channel) might differ from 
an XYZ channel. Television video 47 is overlaid with electronic program guide 
48 that has been tailored to GWC. Sample HTML-pseudocode 49 is described in 
Figure 7(b). 

20 The application of HTML-psuedocodes allows for a considerable level of 

functionality on a single page. For instance, compare the layouts between GWC, 
as illustrated in Figure 7(a) with that of XYZ, as illustrated in Figures 4(a), 5(a) 
and 6(a). This functionality is easily achieved with ActiveX, Java and NetScape 
Plug-Ins. 

25 As illustrated in Figure 3-7, the present invention allows a broadcaster to 

control the layout of graphics in a television environment by utilizing the 
graphics layout language HTML. However, operating environments other than 
HTML are acceptable. 

Each television channel is essentially a web page designed by the 

30 broadcaster. With the use of plug-ins acting as extensions to web browsers, such 
as Netscape Navigator and Microsoft Internet Explorer, these plug-ins add 
functionality to and/or extend the range of data types that can be used with the 
web browsers. Plug-ins are specifically described in Using HTML 1 ? , lava 1 1 
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and COT (Platinum Edition), authored by Eric Ladd and Jim O'Donnell (Que 
Corporation: 1996), which is hereby incorporated by reference. 

Currently, television type user interfaces are manufacturer-specific 
embedded systems in which each user interface component is either part of a 
5 single executable, or the graphics and behavior are part of a collection of 
executables. With the present invention, each user interface component is 
componentized into objects that define their individual behaviors and 
presentations. Data files using the hypertext markup language (HTML) lays out 
these objects on screen 1. By varying the HTML data files, control is provided 

10 to the broadcaster over what objects are displayed on screen 1, where they are 
placed on screen 1 and to a limited effect, their behavior. This can be 
accomplished without re-writing the executables as would be necessary in other 
television type user interface implementations. 

HTML also provides a means of updating the user interface via a network 

1 5 interface. If a newer version of a component is available, it may be used the next 
time the user accesses the network through any means. Other television type 
user interfaces either require that a hardware component be replaced, an 
electronic memory be burned or a software update load be initiated. 

User interface components are developed as objects that can be 

20 embedded in an HTML format. The components can be implemented using 
Microsoft's ActiveX programming interfaces, Java or any other HTML- 
compatible tool or format. An HTML file is defined which lays out the objects 
within a predetermined space. The HTML file is loaded by an HTML interpreter 
control object (such as a web browser control) which is in itself contained by a 

25 generic user interface container. A generic user interface container provides 
general purpose behaviors which are independent of the individual components 
identified in the HTML file. 

In general, the generic user interface container has no visual 
representations, the objects embedded in the HTML file provide the visual 

30 representation. The generic user interface containers are themselves embedded 
in an HTML file which specifies what user interface containers are available to 
the system as a whole. 
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Figure 8 is a representation of the various television components that 
provide television capability for the present invention. Receiver 50 interfaces 
with TV services software component 5 1 . TV services component 5 1 provides 
audio and video control interfaces to television control 53. Television control 53 
5 interfaces television application 52. Television application 52 also manages a set 
of controls 55 that may appear on some channels. 

When the user changes channels, television application 52 calls the 
appropriate function in TV services 51, which in turn, tunes receiver 50. 
Television application 52 coordinates displays through default layout 54. The 
10 new channel may have a different layout already stored on the machine (either 
by the manufacturer or the broadcaster), or a new layout may be sent in-band 
with the audio and video, or the layout may be sent out-of-band (through an 
internet connection, for example). 

Figure 9 illustrates new page layout 61 received in-band. Receiver 50 
15 sends new page layout 61 to TV services functions 51 which stores the layout. 
When appropriate, TV services function 51 notifies television application 52. 
Television application 52 coordinates displays through default layout 54. The 
new channel may have a different layout already stored on the machine or a new 
layout may be sent in-band or out-of-band with the audio and video. Figure 10 
20 illustrates the display of new page layout 61 . New page layout 61 continues to 
display TV control 53, but may also show previously stored control 65. 

In addition, the definition of screen 1, as referenced in Figure 3, may be 
broadcast to the user in-line with the video content. With analog televisions, 
Intercast and WavePhore technologies send data over the vertical blanking 
25 interval (VBI). With digital televisions, MPEG-2 can transport data streams 
multiplexed with the video and audio elementary streams. Furthermore, the 
broadcaster can update their user interfaces dynamically through any network 
interface, such as a modem, cable network or satellite link. 

The system just described operates within computer 110 which operates 
30 in what is known in the art as a "convergence environment," such that PC 
capability and TV capability are both provided. As a result of a television 
capability operating in this type of environment, the system of the present 
invention allows a broadcaster to use a graphics layout language, such as HTML, 
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to control the placement of television status displays interactively with other 
information or icons that may be simultaneously displayed on the same screen. 
By varying the HTML data files, control is provided to the broadcaster over what 
objects are displayed on screen 1, where they are placed on screen 1 and to a 
5 limited effect, their behavior. This can be accomplished without re-writing the 
executables as would be necessary in other television type user interface 
implementations. 

Although specific embodiments have been illustrated and described 
herein, it will be appreciated by those skilled in the art that any arrangement 
10 which is calculated to achieve the same purpose may be substituted for the 
specific embodiment of the present invention. This application is intended to 
cover any adaptations or variations of the present invention. Therefore, it is 
manifestly intended that this invention be limited only by the following claims 
and equivalents. 
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What is claimed is: 

1 . A computer comprising: 
a hardware component; 

a computer-readable medium; 
5 a graphical user interface component; and 

at least one application program, each application program executed by 
the hardware component from the computer-readable medium, wherein each 
application program independently controls the layout of graphics displayed via 
the graphical user interface when overlaid with a video image provided by the 
1 0 hardware component. 

2. The computer of claim 1, further comprising a hypertext markup 
language (HTML) operating environment wherein each application program is 
able to run within. 

15 

3. The computer of claim 1, wherein the computer-readable medium 
comprises a memory. 

4. The computer of claim 1, wherein the graphical user interface is a full 
20 screen television window in which video images are viewed. 

5. The computer of claim 1 , wherein an image is scaled interactively with 
the graphical user interface when the graphical user interface is not a full screen 
television window in which video images are viewed. 

25 

6. The computer of claim 1, wherein the application program is updated 
through a network interface. 

7. The computer of claim 1, wherein the network interface is via a modem. 

30 

8. The computer of claim 1, wherein the network interface is via a coaxial 
cable. 
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9. The computer of claim 1 , wherein the network interface is via a wireless 
connection. 

10. A computerized system comprising: 

5 a plurality of graphical viewing configurations; and 

a plurality of television viewing configurations; 
wherein the graphical viewing configurations are overlaid with 
corresponding television viewing configurations such that each graphical 
viewing configuration is independently definable in size, position and 
1 0 relationship with respect to the television viewing configuration. 

1 1 . The computerized system of claim 10, wherein the graphical viewing 
configuration is updated through a network interface. 

15 12. A method of controlling graphics in a television environment; comprising 
the steps of: 

creating a data file using a graphics layout language; 

displaying a television image on a screen; and 

displaying a graphics image on the screen, 
20 wherein the graphics image is overlaid with the television image, wherein 

the data file determines the layout of the graphics image on the screen such that 
there is an independent relationship between the graphics image and the 
television image. 

25 13. The method of claim 12, wherein the graphics layout language is a 
hypertext markup language (HTML). 

14. The method of claim 12, wherein the data files are updated via a network 
interface. 

30 

15. A computer-readable medium having computer-executable instructions 
for performing steps comprising: 

creating a data file using a hypertext markup language (HTML); 
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displaying a television image on a screen; and 

displaying the graphics image overlaid on the screen with the television 
image, wherein the data file determines the layout of the graphics image on the 
screen such that there is an independent relationship between the graphics image 
5 and the television image. 

16. A computer comprising: 

a hardware component having a personal computer (PC) mode and 
television (TV) mode; 
1 0 a computer-readable medium; 

a graphical user interface component for viewing the television mode; 

and 

at least one application program, each application program executed by 
the hardware component from the computer-readable medium, wherein each 
1 5 application program independently controls the layout of graphics displayed via 
the graphical user interface when overlaid with a video image provided by the 
hardware component operating in the television mode. 



SUBSTITUTE SHEET (RULE 26) 



WO 99/35832 



1/10 



PCT/US99/00098 




FIG. 1 



SUBSTITUTE SHEET (RULE 26) 



WO 99/35832 



PCTYUS99/00098 



2/10 



216 



VIEWS 



V. 



218 



OVERLAYS 



SYSTEM SERVICES 



DRIVERS 



HARDWARE 



.214 



212 



210 



FIG. 2 



SUBSTITUTE SHEET (RULE 26) 



WO 99/35832 



3/10 



PCT/US99/00098 





FIG. 3B 



7 



<HTML> 
<HEAD> 

<TITLE>XYZChannel</TITLE> 
</HEAD> 



<BODY> 

r<OBj'ECf'TD="XYZCha^ 




_WI DTH^eraO__HEJ_GHT= 600 ^ 

L<paRamIn^ 



6 
7 

8 



</OBJECT> 



WIDTH=32 HEIGHT=32 
C<param'^ 

j <PARAM l„N^A!:.M?.*jr ne " VALUE="10"> 4 

</OBJECT> 




</BODY> 
</HTML> 



FIG. 3C 



SUBSTITUTE SHEET (RULE 26) 



WO 99/35832 



4/10 



PCT7US99/00098 



CHANNEL BANNER -#-15 
TV 



FIG. 4A 



<HTML> 
<HEAD> 

<TITLE>XYZBonner</TITLE> 
</HEAD> 

<BODY> 



<OBJECT ID="XYZChonnel" ...> L 

.................................. ...^ 

WIDTH=800 HEIGHT=600 



L<PMAM..MME="Displpy".„..^^^ 



</OBJECT> 



; <OBJECT ID="XYZBanner" ...>_] 

WIDTH = 32 HEIGHT=32 



L<P ^RAM..NAME="Prqgrg VALUE = "1 29943"> 

</OBJECT> 



</BODY> 
</HTML> 



FIG. 4B 



SUBSTITUTE SHEET (RULE 26) 



WO 99/35832 



5/10 



PCT/US99/00098 




FIG. 5A 



<HTML> 
<HEAD> 

<TITLE>XYZMenu</TITLE> 
</HEAD> 

<BODY> 



27 



<OBJECT ID= XYZMenu ...> 



WIDTH=800 HEIGHT=600 



L<J?Aj?AM_.NAME="Dte^ 

[ <PARAM NAME="Menu" ' VALUE= v7xYZChannel.html"> 



</OBJECT> 



[ <OBJECT ID="XYZBanner" ...> 4— " 

WIDTH=32 HEIGHT=32 

L.5.? A .?^...^ A .^. E= " lt ? rn 2 ".. .y A kV E= Y/Stock > Tteker"> 
</OBJECT> 



</BODY> 
</HTML> 



FIG. 5B 



SUBSTITUTE SHEET (RULE 26) 



WO 99/35832 PCT/US99/00098 



6/10 




FIG. 6A 




<HTML> 
<HEAD> 

<TITLE>XYZSports</TITLE> 
</HEAD> 

<BODY> 



<OBJECT ID="XYZChonnel" 



WIDTH=800 HEIGHT=300 

i <PARAM NA^ VALUE="l66"> 



</OBJECT> 



.5.91^£T..JP=." x „T.?.?P°^ll.:::.>d " ~~ 

WIDTH = 32 HEIGHT=80 

</OBJECT> 



</BODY> 
</HTML> 



FIG. 6B 



SUBSTITUTE SHEET (RULE 26) 



WO 99/35832 



7/10 



PCT/US99/00098 



Tonight 
on GWC 






r" w 



36 



37 



FIG. 7A 



<HTML> 
<HEAD> 

<TITLE>GWCChannel</TITLE> 
</HEAD> 

<B0DY> 

^^L^Jtj=BQR..]i^l?^T=JB00 

["<param"name'= j 

[ <PARAM r"NAME*= : 'Menu"" VALUE="GWCMenu.html"> j 



49 



.............. *.....< 



</0BJECT> 



WIDTH=150 HEIGHT=600 
[!<paRam"name= 

L<? A 5 A M...N^ 

</0BJECT> 



</BODY> 
</HTML> 



FIG. 7B 



SUBSTITUTE SHEET (RULE 26) 



WO 99/35832 



8/10 



PCT/US99/00098 




CO 

z 
O 



CO 

o 

CL 



CO 
< 
X 



< 

LU 
CO 



CO 

co O 
o 



CO 

m O 
O != 

CO O 

o 



CO 
LU O 

O != 

co o 
o 




00 

CD 



z 
o 

o 

_l 
Q. 
CL 
< 



o 
on 
h- 
z 
o 
o 



n 

CM 



o 
in 



in 



X 



1 



1 



CO 






LU 






O 




LU 


> 




> 






LU 


< — ► 


LU 




O 


TVS 




RE 



SUBSTITUTE SHEET (RULE 26) 



WO 99/35832 



9/10 



PCT/US99/00098 




CO 
Z 

g 

H 

CO 

o 

CL 



CO 

< 
I 



S5 

I- 
CO 



Q 
LU 

e 

CO 



CO 

-J 

o 
on 

o 
o 



CO 
O — 1 
LU O 

a: 

o != 
(— z 

co O 

o 



CO 
CO O 

o 



in 
in 



5 

CO 

< 




CD 



< 
o 

—J 
CL 

a. 
< 



z 
o 
o 



o 



>■ 

LL 

o 
z 



1 



CO 






LU 




a: 


O 




UJ 


> 




> 






LU 


* — ► 


LU 




a 


CO 




LU 


TV 







SUBSTITUTE SHEET (RULE 26) 



WO 99/35832 



10/10 



PCT/US99/00098 




SUBSTITUTE SHEET (RULE 26) 



INTERNATIONAL SEARCH REPORT 



In tlonal Application No 

PCT/US 99/00098 



A. CLASSIFICATION OF SUBJECT MATTER , 

IPC 6 H04N5/445 H04N7/16 



According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched {classification system followed by classification symbols) 

IPC 6 H04N 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practical, search terms used) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category ° 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


X 


US 5 659 350 A (BONNER ALFRED E ET AL) 


1,3,6,8, 




19 August 1997 


10-12, 






14-16 


Y 


see column 3, line 17 - line 30 


2,13 




see column 9, line 62 - column 10, line 9 






see column 11, line 1 - line 20 






see column 13, line 9 - line 27 






see column 37, line 58 - column 38 , line 






30 




Y 


EP 0 810 579 A (MATSUSHITA ELECTRIC IND CO 


2,13 




LTD) 3 December 1997 






see column 1, line 7 - line 12 






see column 3, line 48 - column 4, line 4 






-/-- 





m 



Further documents are listed in the continuation of box C. 



Patent lamify members are listed in annex. 



• Special categories of cited documents : 

"A" document defining the general state of the art which is not 
considered to be of particular relevance 

"E" earlier document but published on or after the international 
filing date 

X" document which may throw doubts on priority claim(s) or 
which is cited to establish the publication date of another 
citation or other special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or 
other means 

"P° document published prior to the international filing date but 
later than the priority date claimed 



T" later document published after the international filing date 
or priority date and not in conflict with the application but 
cited to understand the principle or theory underlying the 
invention 

"X" document of particular relevance; the claimed invention 
cannot be considered novel or cannot be considered to 
involve an inventive step when the document is taken alone 

"Y" document of particular relevance; the claimed invention 
cannot be considered to involve an inventive step when the 
document is combined with one or more other such docu- 
ments, such combination being obvious to a person skilled 
In the art. 

"&* document member of the same patent family 



Date of the actual completion of the international search 

31 March 1999 


Date of mailing of the international search report 

08/04/1999 


Name and mailing address ot the ISA 

European Patent Office, P.B. 5618 Patenttaan 2 
NL • 2260 KV Rljswijk 
Tel. (+31-70) 340-2040, Tx. 31 651 epo nl, 
Fax: (+31-70) 340-3016 


Authorized officer 

SlncMc, G 



Form PCT71SA/210 (second shoot) (July 1992) 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 



In itlonol Application No 

PCT/US 99/00098 



C(Continuation) DOCUMENTS CONSIDERED TO BE RELEVANT 



Category 1 Citation ot document, with indication. where appropriate, of the relevant passages 



Relevant to claim No. 



p.x 



p.x 



"VERKNUEPFUNG VON TV HIT INTERNET" 
FUNKSCHAU, 

vol. 68, no. 18, 16 August 1996, page 
70/71 XP000631189 

see page 70, middle column, paragraph 3 
page 71, column 1, paragraph 1 

EP 0 746 152 A (IBM) 4 December 1996 



see page 23, line 54 - page 25, line 37 

GB 2 323 489 A (MICROSOFT CORP) 
23 September 1998 

see page 9, line 7 - line 16 

see page 11, line 15 - page 12, line 2 

see page 19, line 8 - line 20 

EP 0 837 599 A (NEXTLEVEL SYSTEMS INC) 

22 April 1998 

see page 3, line 37 - line 43 

see page 5, line 12 - line 15 

see page 8, line 9 - line 46 



1,10,12, 
15,16 



1.3,4, 
10,12, 
15,16 



1-5,10, 

12,13, 

15,16 



1-3,10, 

12,13, 

15,16 



Form PCT71SA/21 0 (continuation ot second sheet) (July 1 992) 



page 2 of 2 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 



Ir itlonof Application No 

PCT/US 99/00098 



Patent document 
cited in search report 


Publication 
date 


Patent family 
members) 


Publication 
date 




A 


19-08-1997 


Aft 

AU 


c a ion 


D 
D 


14-05-1998 






AM 

AU 




A 
A 


19-06-1995 






D D 
bK 


rtjtflOOl 0 

y4Uo212 


A 

A 


26-08-1997 






r a 
CA 


01 771 CO 
Cll 1 IOC 


A 

A 


08-06-1995 






CP 


\Jf J2UJU 


A 

A 


18-09-1996 






T 1 

1L 


111 OCf\ 


A 

A 


22-02-1998 






1 D 

Jr 


ybUo22o 


T 
I 


17-06-1997 






M7 


077X OC 
2/742b 


A 

A 


29-01-1997 






WU 


QC1 CCC7 

yblbob/ 


A 

A 


08-06-1995 






Uo 


bt>00b/3 


A 

A 


04-02-1997 






AT 

A 1 


1 77077 

1/72// 


T 

T 


15-03-1999 






AT 

A 1 


1 7dQA A 


T 

1 


15-03-1999 






AT 
A 1 


1 7£Oy1 1 
1/0841 


T 
1 


15-03-1999 






At 1 

AU 


4440/9/ 


A 


29-01-1998 






A 1 1 

AU 


A CO OCrt.7 

4532b9/ 


A 

A 


05-02-1998 






Al 1 

AU 


OSJ/ /b 


n 
D 


09-07-1998 






Al 1 

AU 


oi J^yy4 


A 

A 


04-07-1994 






A 1 1 

AU 


692427 


B 


11-06-1998 






A 1 1 

AU 


5733094 


A 


04-07-1994 






A 1 1 

AU 


691479 


B 


21-05-1998 






A 1 1 

AU 


5733194 


A 


04-07-1994 






Al 1 

AU 


692428 


B 


11-06-1998 






Al 1 

AU 


5733294 


A 


04-07-1994 






A 1 1 

AU 


5736394 


A 


04-07-1994 






A 1 1 

AU 


5845894 


A 


22-06-1994 






All 

AU 


5869894 


A 


04-07-1994 






Al 1 

AU 


6066798 A 


04-06-1998 






Alt 

AU 


6066898 


A 


04-06-1998 






r a 
CA 


2151456 


A 


23-06-1994 






r a 
OA 


2151457 


A 


23-06-1994 






P A 

CA 


2151458 


A 


23-06-1994 






r a 
CA 


2151459 


A 


23-06-1994 






/* A 

CA 


2151460 


A 


23-06-1994 






f* A 

CA 


2151461 


A 


09-06-1994 






f* A 

CA 


2151462 


A 


23-06-1994 






CN 


1093211 


A 


05-10-1994 






CN 


1090451 


A 


03-08-1994 






CN 


1090452 


A 


03-08-1994 






CN 


1096151 


A 


07-12-1994 






CN 


1090453 


A 


03-08-1994 






CN 


1090454 


A 


ni no i nt\A 
0J-Q8-1994 






Dt 


69323560 


D 


25-03-1999 






0E 


69323562 


D 


OC AO in Art 

25-03-1999 






EP 


0673578 


A 


27-09-1995 






EP 


0673579 


A 


27-09-1995 






CO 

EP 


0673580 


A 


27-09-1995 






EP 


0673581 


A 


27-09-1995 


EP 0810579 


A 


03-12-1997 


JP 


10105355 


A 


24-04-1998 


EP 0746152 


A 


04-12-1996 


US 


5606374 


A 


25-02-1997 






JP 


8331414 


A 


13-12-1996 


GB 2323489 


A 


23-09-1998 


DE 


19811910 


A 


24-09-1998 






FR 


2762114 


A 


16-10-1998 






JP 


11032272 


A 


02-02-1999 


EP 0837599 


A 


22-04-1998 


AU 


4272697 A 


23-04-1998 



Form PCT/ISA/210 (patent famly annex) (July 1692) 



page 1 of 2 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 



tm tlonal Application No 

PCT/US 99/00098 



Patent document 
cited in search report 



Publication 
date 



Patent family 
member(s) 



Publication 
date 



EP 0837599 



CA 2218164 A 

CN 1180973 A 

JP 10234018 A 

NO 974836 A 



21- 04-1998 
06-05-1998 
02-09-1998 

22- 04-1998 



Form PCT71SA/210 (patent temiy imox) (JUy 1902) 



page 2 of 2 



